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Abstract: Herein, we review the properties of the Amoroso distribution, 
the natural unification of the gamma and extreme value distribution fami- 
lies. Over 50 distinct, named distributions (and twice as many synonyms) 
occur as special cases or limiting forms. Consequently, this single simple 
functional form encapsulates and systematizes an extensive menagerie of 
interesting and common probability distributions. 
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1. The Amoroso distribution family 


The Amoroso (generalized gamma, Stacy-Mihram) distribution [2, 22] is a 
four parameter, continuous, univariate, unimodal probability density, with semi- 
infinite range. The functional form in the most straightforward parameterization 


1S 


aB-1 B 
Amoroso(r|a, 0, a, B) = ra H (=) exp 4 — (552) (1) 


for x, a, 0, a, B in R, a>0, 
support x >aifO>0, r<aifé<0. 
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The Amoroso distribution was originally developed to model lifetimes [2]. It 
occurs as the Weibullization of the standard gamma distribution (5) and, with 
integer a, in extreme value statistics (28). The Amoroso distribution is itself a 
limiting form of various more general distributions, most notable the generalized 
beta and generalized beta prime distributions [32]. 

A useful and important property of the Amoroso distribution is that many 
common and interesting probability distributions occur as special cases or limits 
(See Table 1). (Informally, an “interesting distribution” is one that has acquired 
a name, which generally indicates that the distribution is the solution to one 
or more interesting problems.) This provides a convenient method for system- 
izing a significant fraction of the probability distributions that are encountered 
in practice, provides a consistent parameterization for those distributions, and 
obviates the need to enumerate the properties (mean, mode, variance, entropy 
and so on) of each and every specialization. 


Notation: The four real parameters of the Amoroso distribution consist of a 
location parameter a, a scale parameter 0, and two shape parameters, o and £. 
Whenever these symbols appears in special cases or limiting forms, they refer 
directly to the parameters of the Amoroso distribution. The shape parameter o 
is positive, and in many specializations an integer, o = n, or half-integer, o = E, 
The negation of a standard parameter is indicated by a bar, e.g. 8 = —8. The 
chi, chi-squared and related distributions are traditionally parameterized with 
the scale parameter ø, where 0 = (207)'/8, and ø is the standard deviation of 
a related normal distribution. Additional alternative parameters are introduced 
as necessary. 

We write Amoroso(r|a, 0, o, 3) for a density function, Amoroso(a, 0, a, 8) for 
the corresponding random variables, and X ~ Amoroso(a, 0, o, B) to indicate 
that two random variables have the same probability distribution [15]. 


1.1. Special cases: Miscellaneous 


Stacy (hyper gamma, generalized Weibull, Nukiyama-Tanasawa, generalized 
gamma, generalized semi-normal, hydrograph, Leonard hydrograph, transformed 
Stacy(z|0, o, 8) 2—— |5 


gamma) distribution [41, 6]: 
wa wj e 


—Amoroso(z|0, 6, a, 8) 


1 j£ 


If we drop the location parameter from Amoroso, then we obtain the Stacy, or 
generalized gamma distribution, the parent of the gamma family of distribu- 
tions. If B is negative then the distribution is generalized inverse gamma, 
the parent of various inverse distributions, including the inverse gamma (20) 
and inverse chi (26). 
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TABLE 1 
The Amoroso family of distributions. 


a TEAM Ss B 
Amoroso(z|a, 6, a, B) ^W H (= 2 d exp {- (= s 2) \ 
a 


for x, a, 0, a, Bin R, oz, 


k, n positive integers 


support x >aif@>0, x<aif0 <0. 


(1) Amoroso a 0 a B 
(2) Stacy 0 : 
(28 gen. Fisher-Tippett n 
(29 Fisher-Tippett 1 . 
(33) Fréchet 1 <0 
(32) generalized Fréchet n <0 
(25) scaled inverse chi 0 . lk -2 
(26 inverse chi 0 P i k -2 
(27 inverse Rayleigh 0 ; 1 -2 
(19 Pearson type V : : : -1 
(20 inverse gamma 0 z ; -1 
(23 scaled inverse chi-square 0 : lk -1 
(24) inverse chi-square 0 i iy -1 
(22) Lévy : E -1 
(21 inverse exponential 0 : 1 -1 
ES Pearson type III : : ; 1 
(5 gamma 0 : 1 
(5 Erlang 0 >0 n 1 
(6 standard gamma 0 1 ; 1 
(13) scaled chi-square 0 ik 1 
(12) chi-square 0 2 i k 1 
(9 shifted exponential 1 1 
(8 exponential 0 1 1 
(8 standard exponential 0 1 1 1 
(5 Wien 0 4 1 
(10 Nakagami , 2 
(15) scaled chi 0 lk 2 
(14) chi 0 v2 n 2 
(11 half-normal 0 i 2 
(16 Rayleigh 0 1 2 
(17) Maxwell 0 3 2 
(18)  Wilson-Hilferty 0 : 3 
(30) generalized Weibull n 20 
(31) Weibull 1  »0 
(4) pseudo- Weibull 1+ 3 >0 
(3) stretched exponential 0 1 >0 
Limits 
(34)  log-gamma : . ; . limg—oo 
(44) power law SCC Dau 
(42)  log-normal : , Boy limg—o 
(43) normal s . : 1 Dm. 


Fic 1. Amoroso(z|0, 1, 1, 8), stretched exponential 


The Stacy distribution is obtained as the positive even powers, modulus, and 
powers of the modulus of a centered, normal random variable (43), 


1 2 
8 B 
Stacy Ca ; x) ~ |Normal(0, e) 


and as powers of the sum of squares of k centered, normal random variables. 
1 


Stacy Cay 14,8) ~ E (Normal(0, d ° 


Ga 


Stretched exponential distribution [27]: 


B—1 B 
StretchedExp(z|0, 3) = (=) exp 4 — (Z) (3) 
IW: 0 
for B 0 
—Weibull(z|0, 0, 8) 
—Amoroso(z|0, 0, 1, 8) 
Stretched exponentials are an alternative to power laws for modeling fat tailed 
distributions. For 6 = 1 we recover the exponential distribution (8), and 6 = 0 
a power law distribution (44). 


Pseudo-Weibull distribution [44]: 
l 1 B ree qx 
for B 0 
—Amoroso(z|0, 0,1 4- 3.) 


p=4 


B=3, Wilson-Hilferty 


B=2, scaled chi 
0.5 


Fic 2. Amoroso(z|0, 1, 2, 8) 


Proposed as another model of failure times. 


1.2. Special cases: Positive integer B 


Gamma (T) distribution [35, 36, 22] : 


1 At x 
Gamma(z|0, oi = T(o)l6l (2) exp i55) (5) 
= PearsonlII(z|0, 0, a) 
= Stacy(x|0, a, 1) 


= Amoroso(z|0, 0, a, 1) 


The name of this distribution derives from the normalization constant. The 
gamma distribution often appear as a solution to problems in statistical physics. 
For example, the energy density of a classical ideal gas; or the Wien (Vienna) 
distribution Wien(r|T) = Gamma(r|T,4), an approximation to the relative 
intensity of black body radiation as a function of the frequency. The Erlang (m- 
Erlang) distribution [8] is a gamma distribution with integer a, which models the 
waiting time to observe a events from a Poisson process with rate 1/0 (0 > 0). 
Gamma distributions obey an addition property: 


Gamma(6, o4) + Gamma(6, a2) ~ Gamma(6, o4 + a2) 


The sum of two independent, gamma distributed random variables (with com- 
mon Ó's, but possibly different a’s) is again a gamma random variable [22]. 


Standard gamma (standard Amoroso) distribution [22]: 
1 


StdGamma(x|a) = not x" (6) 


Fic 3. Gamma(z|+, a) (unit variance) 


The Amoroso distribution can be obtained from the standard gamma distribu- 


tion by the Weibull change of variables, x — (eu 


1/8 
Amoroso(a, 0, o, B) ^ a 4- 0 [StdGamma(a)] 


Pearson type III distribution [36, 22]: 


PearsonlII(z|a, 0, œ) SE (555) us exp f- (* " *) \ (7) 


—Amoroso(z|a, 0, a, 1) 


The gamma distribution with a location parameter. 


Exponential (Pearson type X, waiting time, negative exponential) distribu- 
tion [22]: 
Exp(2|6) = exp [- 2] (8) 
[7 0 
= Gamma(z|0, 1) 
= Amoroso(z|0, 0, 1, 1) 


An important property of the exponential distribution is that it is memory- 
less: the conditional probability given that x > c, where c is a positive content, 
is again an exponential distribution with the same scale parameter. The only 
other distribution with this property is the geometric distribution [9], the dis- 
crete analog of the exponential distribution. With 0 = 1 we obtain a standard 
exponential distribution. See also shifted exponential (9), stretched exponen- 
tial (3) and inverse exponential (21). 
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Shifted exponential distribution [22]: 
: 1 0 
ShiftExp(x|a, 0) = " exp { ( 7 )} (9) 


= PearsonlII(z|a, 0,1) 


= Amoroso(z|a, 0, 1, 1) 


The exponential distribution with a location parameter. 


Nakagami (generalized normal, Nakagami-m) distribution [34]: 


Nakagami(z|a, 0, m) = FCU (52) ew f- (: m y (10) 


= Amoroso(r|a, 0, 3, 2) 


Used to model attenuation of radio signals that reach a receiver by multiple 
paths [34]. 


Half-normal (semi-normal, positive definite normal, one-sided normal) distri- 
bution [22]: 


2 gt 
HalfN l = 11 
alfNormal(z|c) ol E (11) 
= ScaledChi(z|o, 1) 
= Stacy(z| V 20?, 1,2) 
= Amoroso(z|0, V20?, 1.2) 


99) 
The modulus of a normal distribution with zero mean and variance o?. 


Chi-square (x?) distribution [11, 22]: 


Gids (5)? eof- (2)) a2 


for positive integer k 
= Gamma(z|2, 5) 
= Stacy(z|2, 5,1) 


k 
= Amoroso(z|0, 2, 5, 1) 
The distribution of a sum of squares of k independent standard normal random 
variables. The chi-square distribution is important for statistical hypothesis test- 
ing in the frequentist approach to statistical inference. 


Fic 4. ChiSqr(z|K) 


Scaled chi-square distribution [28]: 


ScaledChiSqr(z|o, k) = zm Em Zi Së {- (25) ) (13) 


for positive integer k 
= Stacy(x|207, 5,1) 
= Gamma(z|207, £) 
= Amoroso(z|0, 207, 5, 1) 


The distribution of a sum of squares of k independent normal random variables 
with variance o?. 


Chi (x) distribution [22]: 


Chi(z|k) — E (45) " exp f- (2)] (14) 


for positive integer k 
= ScaledChi(z|1, k) 
= Stacy(2| V2, SEN 
= Amoroso(z|0, V2, E. 2) 


The root-mean-square of k independent standard normal variables, or the square 
root of a chi-square random variable. 


Chi(k) ~ \/ChiSqr(k) 


a=1/2, half-normal 


a=1, Rayleigh 
a=3/2, Maxwell 


0.5 


Fic 5. Amoroso(z|0, 1, a, 2) 


Scaled chi (generalized Rayleigh) distribution [33, 22]: 


9 " k—1 r2 
ledChi(z|o, k) = Lie? 
ScaledChi(z]o, k) ri =l Z) exp (55)] 


2 
for positive integer k 


= Stacy(z| V 20?, 5,2) (15) 
= Amoroso(z|0, V 202, 5,2) 


The root-mean-square of k independent and identically distributed normal vari- 
ables with zero mean and variance o?. 


Rayleigh distribution [42, 22]: 


Rayleigh(z|o) = E cz exp {- (Z) (16) 
= ScaledChi(z|o, 2) 
= Stacy(2|V202, 1,2) 
= Amoroso(z|0, V20?, 1, 2) 
The root-mean-square of two independent and identically distributed normal 
variables with zero mean and variance o?. For instance, wind speeds are approx- 


imately Rayleigh distributed, since the horizontal components of the velocity are 
approximately normal, and the vertical component is typically small [24]. 


/ 10 


Maxwell (Maxwell-Boltzmann, Maxwell speed) distribution [30, 1]: 


5 2 

Maxwell(x|o) = x, x” exp {- LZ (17) 
= ScaledChi(z|o, 3) 
= Stacy(2|V 20, 3,2) 
= Amoroso(z|0, v 26?, 3, 2) 


The speed distribution of molecules in thermal equilibrium. The root-mean- 
square of three independent and identically distributed normal variables with 
zero mean and variance c?. 


Wilson-Hilferty distribution [47, 22]: 


WilsonHilferty(z|0, a) = a ET: exp f- EN (18) 


= Stacy(x|0, a, 3) 


= Amoroso(z|0, 0, a, 3) 


The cube root of a gamma variable follows the Wilson-Hilferty distribution [47], 
which has been used to approximate a normal distribution if o is not too small. 
A related approximation using quartic roots of gamma variables [19] leads to 
Amoroso(z|0, 0, a, 4). 


1.3. Special cases: Negative integer 3 


Pearson type V distribution [37]: 


1 deg ó 
PearsonV (za, 0, a) ~T(a) léi PE. exp 4 — SE 
=Amoroso(a|a, 0, o, — 1) (19) 


With negative 8 we obtain various “inverse” distributions related to distribu- 
tions with positive Ø by the reciprocal transformation (*5*) > (2). Pearson’s 


type V is the inverse of Pearson’s type III distribution. 


Inverse gamma (Vinci) distribution [22]: 


ME EUN EE FW (^ gen {- B) (20) 


= Stacy(x|0, œ, —1) 
= Pearson V (z|0, 0, a) 
= Amoroso(z|0, 0, a, —1) 


2.5 - 
2- T BA 
scaled 
B=-1  inverse-chi 
1.5 - inverse 
gamma 
1- 
0.5 + 
0 
0 1 2 


Fic 6. Amoroso(z|0, 1, 2, 8), negative B. 


Occurs as the conjugate prior for an exponential distribution's scale parame- 
ter [22], or the prior for variance of a normal distribution with known mean [15]. 


Inverse exponential distribution [25]: 


InvExp(z|0) = fl epf- B (21) 


x 
= InvGamma(z|0, 1) 

= Stacy(x|0, 1, — 1) 

= Amoroso(2|0, 0, 1, —1) 


Note that the name "inverse exponential" is occasionally used for the ordinary 
exponential distribution (8). 


Lévy distribution (van der Waals profile) [10]: 


Lévy(z|a, c) = d c -y z exp ; Ze =} (22) 


= PearsonV(z|a, $, 2) 


= Amoroso(z|a, $, $,—1) 


The Lévy distribution is notable for being stable: a linear combination of iden- 
tically distributed Lévy distributions is again a Lévy distribution. The other 
stable distributions with analytic forms are the normal distribution (43), which 
is also a limit of the Amoroso distribution, and the Cauchy distribution [22], 
which is not. Lévy distributions describe first passage times in one dimensional 
Brownian diffusion [10]. 
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Scaled inverse chi-square distribution [15]: 


. 2g? 1 ru 1 
ScaledInvChiSqr(z|o, k) “TH 252; RED eem (23) 
2 


for positive integer k 

= InvGamma(z| 54s, £) 
1 k 
= Pearson V (x|0, 275, 5 
= Stacy(a| 53, 5, —1) 
k 
2 


= Amoroso(z|0 


) 


,—1) 


A special case of the inverse gamma distribution with half-integer a. Used as a 
prior for variance parameters in normal models [15]. 


1 
1 2g2* 


Inverse chi-square distribution [15]: 


InvChiSqr(a|k) E (zz) a Se t (zz) \ (24) 


for positive integer k 
= ScaledInvChiSqr(x|1, k) 
= InvGamma(z|2, £) 
= PearsonV(z|0, $, £) 
= Stacy(z|1, 5, —1) 
= Amoroso(z|0, 5, 5, —1) 
A standard scaled inverse chi-square distribution. 


Scaled inverse chi distribution [28]: 


mme" Teu) emu) co 


| 


= Stacy (x| 


e, Zi —2) 
k 
= Amoroso(z|0, A T m 


Used as a prior for the standard deviation of a normal distribution. 


Inverse chi distribution [28]: 


InvChi(z|k) = Eos ex) um f- (zz)] (26) 
E 


standard Gumbel 


reversed Weibull, B=2 Frechet, B=-2 


0.5 - 


Fic 7. Extreme value distributions 


The standard inverse chi distribution. 


Inverse Rayleigh distribution [9]: 


InvRayleigh(r|o) = 2V20? ( zu exp f- Lal (27) 


= Stacy(z| 775, 1, —2) 


= Amoroso(z|0, Za 1,—2) 


The inverse Rayleigh distribution has been used to model failure time [43]. 


1.4. Special cases: Extreme order statistics 


Generalized Fisher-Tippett distribution [40, 3]: 


n = nB—1 E B 
GenFisherTippett(z|a, v, n, 8) = a e (* 3 exp b (* d | 
T(n) |w w w 
for positive integer n (28) 


= Amoroso(z|a, "x ,n, B) 


If we take N samples from a probability distribution, then asymptotically for 
large N and n « N, the distribution of the nth largest (or smallest) sample 
follows a generalized Fisher-Tippett distribution. The parameter 8 depends on 
the tail behavior of the sampled distribution. Roughly speaking, if the tail is 
unbounded and decays exponentially then f limits to oo, if the tail scales as a 
power law then 8 < 0, and if the tail is finite 9 > 0 [17]. In these three limits 
we obtain the Gumbel (39, 38), Fréchet (33, 32) and Weibull (31,30) families 
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of extreme value distribution (Extreme value distributions types I, II and IIT) 
respectively. If 8/w is negative we obtain distributions for the nth maxima, if 
positive then the nth minima. 


Fisher-Tippett (Generalized extreme value, GEV, von Mises-Jenkinson, von 
Mises extreme value) distribution [12, 45, 17, 23]: 


8-1 B 
FisherTippett(z|a, w, 8) = £l € — *) exp f- (* — *) | (29) 


[o W 


= GenFisherTippett(z|a, w, 1, 8) 


= Amoroso(z|a, w, 1, B) 


The asymptotic distribution of the extreme value from a large sample. The 
superclass of type I, II and II (Gumbel, Fréchet, Weibull) extreme value dis- 
tributions [45]. This is the distribution for maximum values with 8/w < 0 and 
minimum values for 3/w > 0. 

The maximum of two Fisher-Tippett random variables (minimum if 3/w > 0) 
is again a Fisher-Tippett random variable. 


max |FisherTTippett(a. w1, 6), FisherTippett(a, we, B) 


DEER 


~ FisherTippett(a, 
102 


Eu 


This follows because taking the maximum of two random variables is equivalent 

to multiplying their cumulative distribution functions, and the Fisher-Tippett 
—a\ Ê 

z=a) 


cumulative distribution function is exp {- ( = 


Generalized Weibull distribution [40, 3]: 
n nB—1 B 
. on B (x—a 8 r—a 
GenWeibull(z|a, w, n, 8) = TG lj ( S ) cl n ( " ) | (30) 
for B 0 
= GenFisherTippett(z|a, w, n, 8) 


= Amoroso(z|a, w/n? n, B) 


The limiting distribution of the nth smallest value of a large number of identi- 
cally distributed random variables that are at least a. If w is negative we obtain 
the distribution of the nth largest value. 


Weibull (Fisher-Tippett type III, Gumbel type III, Rosin-Rammler, Rosin- 
Rammler-Weibull, extreme value type III, Weibull-Gnedenko) distribution [46, 


23]: 


Weibull(z|a, w, 8) = a (5) el =) (31) 


for p > 0 
= FisherTippett(z|a, w, B) 
= Amoroso(z|a, v, 1, 8) 
'This is the limiting distribution of the minimum of a large number of identically 
distributed random variables that are at least a. If w is negative we obtain a 
reversed Weibull (extreme value type III) distribution for maxima. Special 


cases of the Weibull distribution include the exponential (3 = 1) and Rayleigh 
(8 = 2) distributions. 


Generalized Fréchet distribution [40, 3]: 


= n^ B (x-a vus r—a -2 
GenPréchet(ala, on, B) gar) 7 ) exp -n( m ) 


for B » 0 (32) 
= GenFisherTippett(z|a, v», n, — P) 


= Amoroso(z|a, v /n? , n, —p), 


The limiting distribution of the nth largest value of a large number identically 
distributed random variables whose moments are not all finite and are bounded 
from below by a. (If the shape parameter w is negative then minimum rather 
than maxima.) 


Fréchet (extreme value type II , Fisher-Tippett type II, Gumbel type II, inverse 
Weibull) distribution [13, 17]: 


Fréchet(z|a, w, B) = B (* = 220 exp f- € = d | (33) 


— lel 


for B>0 
= FisherTippett(z|a, w, —8) 


= Amoroso(z|a, v, 1, — 8) 


The limiting distribution of the largest of a large number identically distributed 
random variables whose moments are not all finite and are bounded from below 
by a. (If the shape parameter w is negative then minimum rather than maxima.) 


Special cases of the Fréchet distribution include the inverse exponential (3 = 1) 


and inverse Rayleigh (3 = 2) distributions. 


1.5. Properties 


support rz o 0-0 
rca 0«0 
edt 1— Qla, Ceci ER 
r—a B 
Q(a, ( Ü ) ) p <0 
mode a -- (a — 1)5 of zl 
a ap x1 
I(o c5 
std. moments S (a —0,0—1) a+ 5 >0 
Diot 1i 
mean Tr D gd sco 
o 
T(o--2) T(a+4) 
: 2 B B 425 
variance 6 Ta) Ta)? a+4>0 
IR 1 
entropy In S x Got G a) v(a) [6] 


Here, cdf is the cumulative distribution function, Q(o,x) = I'(o,z)/I(a) is 
the regularized gamma function [1], (a, x) = f° t?-1e-!dt is the incomplete 
gamma integral [1], and v(z) = “InI(z) is the digamma function [1], the 
logarithmic derivative of the gamma function. Important special cases and lim- 
its include T(4) = yr, T'(3,z) = Vm erfe(/z) and I'(1,z) = exp(—a). The 
derivative of the regularized gamma function is 4Q(a, £) = -nge le. 

The profile of the Amoroso distribution is bell shaped for a8 > 1, and other- 
wise L- or J- shaped with the mode at the boundary. The moments are undefined 
if the side conditions are not satisfied. Expressions for skew and kurtosis are not 
simple, but can be deduced from the moments if necessary. 

The Amoroso distribution can be obtained from the standard gamma dis- 
tribution (6) with the change of variables, x > Coy Therefore, Amoroso 
random numbers can be obtained by sampling from the standard gamma dis- 
tribution, for instance using the Marsaglia-Tsang fast gamma method [29] and 
applying the appropriate transformation [26]. 


2. Log-gamma distributions 


The log-gamma (Coale-McNeil, gamma-exponential) distribution [4, 39, 23] 
is a three parameter, continuous, univariate, unimodal probability density with 
infinite range. The functional form in the most straightforward parameterization 
is 


PCa A gy TO Ge fa (* i -) dp (* i d \ (34) 


for x, v, A, a, in R, a >Q, 


support — oo < z < oo 


The three real parameters consist of a location parameter v, a scale parame- 
ter A, and a shape parameter a, which is inherited directly from the Amoroso 
distribution. 

The name “log-gamma” arises because the standard log-gamma distribution 
is the logarithmic transform of the standard gamma distribution 


StdLogGamma(a) ~ In (StdGamma(a)) 
LogGamma(r, À, a) ~ In (Amoroso(0, ef. o, 1) 


Note that this naming convention is the opposite of that used for the log-normal 
distribution (42). The name “log-gamma” has also been used for the antilog 
transform of the generalized gamma distribution, which leads to the unit-gamma 
distribution [18]. 

The log-gamma distribution is a limit of the Amoroso distribution (1), and 
itself has a number of important limits and special cases (Table II), which we 
will discuss below. 


LogGamma(z|v, A, a) (35) 


un 1 1 la-v apt 1 la-v B 
= P za TB À ) iii e HOS ) 


= lim Amoroso(v — BX, BA, a, B) 
B—oo 


Recall that limg. , 4; (1 + Sr = exp(x). 
2.1. Special cases 


Standard log-gamma distribution: 


StdLogGamma(z|@) SH exp {ax — exp(x)} (36) 


—LogGamma(z|0, 1, a) 
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TABLE 2 
The log-gamma family of distributions. 


LogGamma(z|v, A, œ) 


"roa o C) 9 62] 


for x, v, A, a, in R, a > 0, 


support — oo < x € oo 


(34 log-gamma D A a 
(36 standard log-gamma 0 1 a 
(37)  log-chi-square In2 1 E 
(38 generalized Gumbel n 
(39 Gumbel 1 
(41) BHP sx = 
(40) standard Gumbel 0 -1 1 
Limits 
(43 normal . . o limas 


The log-gamma distribution with zero location and unit scale. 


Log-chi-square distribution [28]: 


1 k 1 
LogChiS AR e e 
oaChiSerlK) zm ml Se Sen 
for positive integer k (37) 
= LogGamma(z| In 2, 1, E) 
The logarithmic transform of the chi-square distribution (12). 


Generalized Gumbel distribution [17, 23]: 


GenGumbel(a|u, À, n) = Stam ex { n (z S “) nexp (-* * 3r 
n 


for positive integer n (38) 


= LogGamma(z|u + Aln n, —A, n) 


The limiting distribution of the nth largest value of a large number of unbounded 
identically distributed random variables whose probability distribution has an 
exponentially decaying tail. 


Gumbel (Fisher-Tippett type I, Fisher-Tippett-Gumbel, FTG, Gumbel-Fisher- 
Tippett, log-Weibull, extreme value (type I), doubly exponential, double expo- 
nential) distribution [12, 17, 23]: 


Gumbel(a|u,X) = ix exp (532) exp ( 223]. (39) 


= LogGamma(z|u, —A, 1) 


0.5 - 


Fic 8. LogGamma(z|0, 1, a) 


This is the asymptotic extreme value distribution for variables of “exponential 
type”, unbounded with finite moments [17]. With positive scale \ > 0, this 
is an extreme value distribution of the maximum, with negative scale A < 0 
(A > 0) an extreme value distribution of the minimum. Note that the Gumbel 
is sometimes defined with the negative of the scale used here. 

Note that the term “double exponential distribution” can refer to either the 
Gumbel or Laplace [23] distributions. The Gompertz distribution is a truncated 
Gumbel distribution [23]. 


Standard Gumbel (Gumbel) distribution [17]: 


StdGumbel(x) = exp {—x — e *! (40) 
—LogGamma(z|0, —1, 1) 


'The Gumbel distribution with zero location and a unit scale. 


BHP (Bramwell-Holdsworth-Pinton) distribution [5]: 


BHP(z|v, AN = Se exp {5 ES Bm (55) (41) 


= LogGamma(a|p, A, 5) 


Proposed as a model of rare fluctuations in turbulence and other correlated 
systems. 
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2.2. Properties 


support  — oo € x < Lo 
cd? 1— Q(a, e^») for \>0 
Q(a,e* ) for A <0 
T(a + At) 
la ———— 2 
cgf vi+ In To) [23] 


mode v—Alna 
mean v+ Auto) 
variance (a) 
skew sgn(A)v»(o) /1 (a)? 
kurtosis ` dato loin (a)? 
entropy InI(a)|A|—av(a)+a 


Here, cdf is the cumulative distribution function, cgf the cumulant generating 
function, In Eexp(tX)], sgn(z) is the sign function, v,(z) = Ze InT(z) is the 
polygamma function and ¢)(z) = vo(z) is the digamma function. 


3. Miscellaneous limits 


Log-normal (Galton, Galton-McAlister, antilog-normal, logarithmic-normal, 
logarithmico-normal, Cobb-Douglas, A) distribution [14, 31, 22]: 


d z—aM! 1 a—a\* 
LogNormal(z|a, d. o) = Janet (555) exp E (1 z) | (42) 
= mi Amoroso(zr|a, 0(Bo)7/?, 1/(Ba)?, B) 
EN 


'The log-normal distribution is a limiting form of the gamma family. To see this, 
make the requisite substitutions, 


Amoroso(z|a, 0(8o)?/?, 1/(8o)?, B) 


z—a\ t 1 me? 1 men” 
x 3 exp EES n 3 KEES exp | 1n 3 
and in the limit 6 — 0 expand the second exponential to second order in £. 
With a = 0, à = 1, c = 1 we obtain the standard log-normal (Gibrat) 
distribution [16]. The two-parameter lognormal distribution (a — 0) arises 


from the multiplicative version of the central limits theorem: When the sum of 
independent random variables limits to normal, the product of those random 
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variables limits to log-normal. The log-normal distribution maps to the normal 
distribution with the transformation x ++ exp(x). 


LogNormal(a, 0, o) ~ exp (Normal(In d. e) +a 


Normal (Gauss, Gaussian, bell curve, Laplace-Gauss, de Moivre, error, Laplace’s 
second law of error, law of error) distribution [7, 22]: 


1 (=p) 
4 
aon {St (43) 
B lim Amoroso(z|u — go, a / /a, a, 1) 


= lim LogGamma(z|p — ovalna, ova, o) 
Gë ks dei 


Normal(zx|u, 7) = 


With u = 0 and o = 1/V/2h we obtain the error function distribution, and 
with u = 0 and o = 1 we obtain the standard normal (®, z, unit normal) 
distribution. In the limit that o — oo we obtain an unbounded uniform (flat 
distribution, and in the limit o — 0 we obtain a delta (degenerate) distribution. 

The normal distribution is a limit of the Amoroso [22] and log-gamma dis- 
tributions [39]. For Amoroso, make the requisite substitutions, 


Amoroso(z|u — ova, 0/V/a, a, 1) 
= - we 

x exp{ vaz P 1 (o Di (14 7 3] 
c a 


and expand the logarithm as In(1 + x) = x — E + O(a?). 


Power-law (Pearson type XI, fractal) distribution [38]: 
1 
(x — a)? 


= lim Amoroso(a, 0, a, (1 — p)/a) 


PowerLaw(z|p) œ (44) 


Improper (unnormalizable) power law distributions are obtained as a limit of the 
gamma distribution family. If p — 0 we obtain the half-uniform distribution 
over the positive numbers; if p — 1 we obtain Jeffreys distribution [21], used 
as an uninformative prior in Bayesian probability [20]. 


Acknowledgments: I am grateful to David Sivak, Edward E. Ayoub and 
Francis J. O'Brien for spotting various typos and errors, and, as always, to Av- 
ery Brooks for many insightful observations. In curating this collection of dis- 
tributions, I have benefited mightily from Johnson, Kotz, and Balakrishnan's 
monumental compendiums [22, 23], Eric Weisstein's MathWorld, and the myr- 
iad pseudo-anonymous contributors to Wikipedia. An extended enumeration of 
simple probability distribution families can be found at threeplusone.com/gud. 
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Appendix A: Index of distributions 


generalized-X The only consistent meaning is that distribution *X" is a spe- 
cial case of the distribution “generalized-X”. In practice, often means “add a 
shape parameter". 


standard-X The distribution ^X" with the location parameter set to 0, scale 
to 1, and often the Weibull shape parameter 8 to 1. Not to be confused with 
standardized which generally indicates zero mean and unit variance. 


shifted-X (or translated) A distribution with an additional location parame- 
ter. 


scaled-X (or scale-X) A distribution with an additional scale parameter. 


inverse-X (Occasionally inverted-X, reciprocal-X, or negative-X) Generally 
labels the transformed distribution with z — i, or more generally the distribu- 
tion with the Weibull shape parameter negated, 8 — —]. An exception is the 
inverse normal distribution [22]. 


log-X If x follows distribution X then either y = Inz (e.g. log-normal) or 
y = e” (e.g. log-gamma) follows log-X. This ambiguity arrises because although 
the second convention is more logical, the log-normal convention has historical 
precedence. 


reversed-X (Occasionally negative-X) The scale is negated. 


X of the Nth kind See “X type N”. 


Distribution Synonym or Equation 
EE chi 
EE chi-square 
UE gamma 
ENEE log-normal 
VE standard normal 
antilog-normal: «2:22 mh EE EERE See Ed Se log-normal 
ee EE (1) 
bell curve gc be eds E RP PAR REP e ae tenet wees normal 
BHP Ne Eege tala e Us Ne Sole p estie eet bud HER (41) 
Bramwell-Holdsworth-Pinton .............. sese BHP 
dig EET (14) 
chi-square EEN (12) 
Coale-McNell i scidcctwimeaiiaoeeronseaaditvna saad RUE generalized log-gamma 
Cobb-Douglas i.e rer Ret deter d EEN dee SE log-normal 


dë MOTE. eh EE SE EE Ee qas normal 


degenerate EE delta 
eltern Sake ge e AE See normal (43) 
doubly exponential... 11221 ke ue rer d dV EPI ERIS Gumbel 
double exponential ............ssseeseeeeeee eee eens Gumbel or Laplace 
GANS Mp I" See gamma (5) 
EE normal 
GEGEND EIOS ee me arte ee ae Rd See normal (43) 
EE (8) 
extreme Value us ee dere Ee Gumbel 
extreme value type Ne Fisher-Tippett type N 
Fisher-Tippelt:oeces epi beteiligen EE quu Ee (29) 
Fisher-Tippett type le EEN EEN sempe ete Gumbel 
Fisher-Tippett type IL AEN EEN kr teer RR Fréchet 
Fisher-Tippett type IT. Weibull 
Fisher-Tippett-Gumbel ............ 0... cece eee eee ee Gumbel 
cre MERE power law 
uL C TH" LET uniform 
Ig. Ig HT "PE (33) 
KEE Fisher-Tippett-Gumbel 
GAON tee ian ee EEN Joe normal 
Galton-McAlister `... log-normal 
EE (5) 
gamma-exponential .......... ccc cece cece eee nnm log-gamma 
GAUSSIAN. EE normal 
GAUSS "e normal 
generalized gamma `... Stacy or Amoroso 
generalized inverse gamma ............. 00 cece cece eee eee eee See Stacy (2) 
generalized Gumbel el b rere eens viewed d AN EE ANS) (38) 
generalized extreme value `... Fisher-Tippett 
generalized Hisbher "Uppert... (28) 
generalized Fréchet `... (32) 
generalized inverse gamma ............ esses generalized gamma 
generalized normal .......... ccc cece cece eee eee eee eee e EAR Nakagami 
generalized Rayleigh Siwe HERE at PR RE okrenio d'SS whites scaled chi 
generalized semi-normal ......... 0.0... cece cece cence eee een nena Stacy 
generalized Weibull Ak SEENEN et bees pe Rye ee Hb qe ib Ae 30) 
GEM EE generalized extreme value 
lor een Ed standard log-normal 
enun mcr 39) 
Gumbel-Fisher-Tippett ..............ssssssessese eee eee n eee naee Gumbel 
Gumbel type N ENEE NEEN rancor seer dE Ee Fisher-Tippett type N 
EE 11) 
half-ünform see KEREN ean pr RR LAT PR Rr ed See power law (44) 
hydrograph, PPM Stacy 
hyper amma s ioe crue MER dree CER eoe P Uu NEEN Stacy 
inyérse EE 26) 


Inyerse Chi-square ee de EE EEN deg AN See (24) 
inyerse REGIERUNG (21) 
SEET (20) 
inverse Rayleigh. 2423. ec ete EE NEEN e ted ete cee’ (27) 
inyerse Weibull AE at ie eed Soe eae Ve eee TA pn ER d e Fréchet 
BIEN See power law (44) 
Laplace’s second law of error ........ 0.0 e cece eee eee eee normal 
Laplace-Gauss 4: icsebetbspcI re rer rant weeded Peete E ed ERE normal 
Ia OL'GIrTOE EE normal 
Leonard hydrograph 1.2... aes essem e be nre erbe Stacy 
I RT (22) 
log-chi-sġuare "MT (37) 
log gamma EE (34) 
logenormal iyu dE EE d EE E A Ee ee (42) 
log-normal, two parameter ............ essen See log-normal (42) 
log: Weibull), 44. erre prre d Are e avons OE Re e hdd Gumbel 
logarithmic-normal ees d NEEN a Eh ere OPER ESO ER log-normal 
logarithmico-normal .............seeseeeeee ene eas log-normal 
e.g" —————Ó—M—Mmm (17) 
Maxwell-Boltzrianri. — dein d Errata wes i ees a eee ade ERR E Rs Maxwell 
Maxwell speed 1.0.0... 0c cece cece eect e ene eee eene Maxwell 
In-Erlang EE Erlang 
EE (10) 
Naka gami-m: 4.0.05 ei Reg AER EE E E EN ER Nakagami 
negative exponential ........... 00. cece eee eee ees exponential 
EE (43) 
Nukiyama-Tanasawa ........ esee generalized gamma 
one-sided normal 2 9 EEN seeded aer re ger le reb ee half-normal 
SE DEE (7) 
Pearson type V "ost ERR dE EN eh ica va Rae Fa Ee bine eda ida eh (19) 
Pearson type X. «seco niei ple te ead Bee e bane’ exponential 
Pearson type Xl 12:224 923 ENEE a PRIX qe wieder ds power law 
positive definite normal .............. esses eh half-normal 
POW! James Ad ge eda Ib eter e EE dee ee dh éiere 44) 
pseudo- Weibull 4. rerba E EE EEN we yeh ancien OU a hawt . (4) 
Rayleéigli ov sce cesar PRU Dae ee ed diay CRINE RC le Ded es 16) 
Rosim-Rammler 2.222 merde e Iber UR RUM RU ERER RR RU CUERO ing Ee nd Weibull 
Rosin-Rammler-Weibull ,,,, een cence enna Weibull 
scaled Chi EE 15) 
scaled. chi-square: EE 13) 
scaled inverse chi TC 25) 
scaled inverse chi-square .........0.. 0.0. e eee e cece cee nene 23) 
gémi- Normal 4421523 veto ERRARE Ee aden ein half-normal 
shifted exponential ex d SEN E Xr kan pelea adi onis DENEN A RENE (9) 
e EE (2) 
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standard ÀÁmoroso `... standard gamma 
standard exponential ............ 0000s ese eee eee aes See exponential (8) 
standard GAMMA EE rds dE ENEE NEE salen meds SA gules (6) 
standard. Gumbel. esccasadiid ene EA d pbi EX EEN ER 40) 
standard log-famma AEN EE EEN eem re d n 36) 
standard oe-nommal,,,, cence eee eee See log-normal (42) 
Standard Morel EE See normal (43) 
stretched exponential ............. 0. cece cece eens (3) 
transformed gamma; EEN ees e eve E RENE REENEN Stacy 
HOER setae yates i dE ENEE ge See normal (43) 
unit ee EE standard normal 
van der Waals profile `... Lévy 
VIENNA sccstiss e bed cage X LR ERE el yale aie iba pbs RI ER Qd REY Wien 
KA EE inverse gamma 
von Mises extreme value ........... 0. eee e cece e eee ee eee eens Fisher-Tippett 
von Mises-Jenkinson `... Fisher-Tippett 
KEE exponential 
ome E Ee deed (31) 
Weibull-Gnedenko `... Weibull 
WHC p eat tees E ve See gamma (5) 
KE H EE (18) 
EE standard normal 
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